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Abstract. We prove the existence of sampling space with 
the interpolation property on a fairly large class of step two 
nilpotent Lie groups. Let N be a simply connected, con- 
nected, two step nilpotent Lie group with Lie algebra n such 
that n = a © b © 3, [a, b] C 3, the algebras a, b are commuta- 
tive and have the same dimension. Moreover we assume that 
det ([Xi, Yj]) x<i j <d is a non- vanishing polynomial on the com- 
mutator ideal [a, b] . We prove the existence of a set T c N, 
and a left-invariant subspace H in L 2 (N) such that H is a 
sampling space with respect to L and H has the interpolation 
property. A sinc-type function is constructed explicitly. Also, 
many examples are computed to support our results. 



1. Introduction 

A function / e L 2 (R) is bandlimited to [—a, a] if the support of 
its Fourier transform is contained in [—a, a] . When a = 1/2, we call 
such space the Paley- Wiener space in L 2 (R) . It is a well-known fact 
that bandlimited spaces are invariant under the action of the left 
regular representation of R. Another fact which will be of special 
interest in this paper is the following. The integer translates of the 
Fourier inverse transform of the characteristic function of the in- 
terval [—1/2, 1/2] forms an ortho normal basis for the Paley- Wiener 
space. As a result, we have a precise algorithm for reconstructing 
an arbitrary bandlimited function / from countably many sample 
values {/ (k) : k e Z} . Let 

H = {/ G L 2 (R) n C (R) : supp {f) C [-1/2, 1/2]} . 
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For all / 6 H, 

fcez ^ ' 

and the series converges unconditionally in L 2 -norm. Moreover 



The function is called the sine function. The series in ([[]) 

gave rise to the uniform sampling theory of Shannon which plays 
an important role in digital signal processing. 

The basic mathematical question: which locally compact groups 
G and which closed left-invariant subspaces of L 2 (G) admit sinc- 
type functions? is an open question. In fact, if R is replaced with 
a nonabelian locally compact group G then it is not clear in gen- 
eral what should be the analogue of Z, and how to generalize the 
concept of bandlimitation. Pesenson [9j introduced a geometric 
definition of bandlimitation on stratified Lie groups. He defines a 
bandlimited function to be a function whose sub-Laplacian trans- 
form is supported on a bounded subset of the real line. Fiihr and 
Grochenig [7J also use Pesenson's definition for stratified nilpotent 
in [7J. Additionally, they replace Z with some quasi-lattice in G. 
Their results are very general and very precise. However, they were 
only able to construct frames as opposed to orthonormal bases. In 
[I] , Dooley investigated the same question for motion groups of the 
type M fc x K for a compact group K. Currey and Mayeli special- 
ized to the 3-dimensional Heisenberg group in PQ, and they define 
a function to be bandlimited whenever its group Fourier transform 
is supported on a bounded subset of the spectrum of the left reg- 
ular representation of the Heisenberg group. We remark that this 
definition is much closer and natural to the classical definition of 
bandlimitation than the definition used in [7J. Also, for a class of 
two-step nilpotent Lie groups, we have obtained some specific con- 
ditions in [S] for the construction of Parseval frames in bandlimited 
spaces using a similar definition to the one used in pQ. We would 
like to remark that the work by Currey and Azita in [T] suggest that 
similar results could also be obtained for other non commutative 
type of nilpotent Lie groups. 

In this paper, we consider the same class of nilpotent Lie groups 
studied in [8]. It is a class of two-step nilpotent Lie groups which is 
a natural generalization of the Heisenberg groups. Here is a precise 
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description of this class of groups. Let N be a non- commutative 
connected, simply connected nilpotent Lie group with Lie algebra 
n over the reals. Fix a Jordan Holder basis for the Lie algebra of N 
such that o = R-span {X\, • • • , X d } , and b = IR-span {Y%, • • • , Y d } . 
Moreover, we assume that 

n = a© b ©3, [a, b] c 3, 

the algebras a and b are commutative and have the same dimension. 
Finally, we assume that the determinant of the matrix ([JQ, Yj\) 1<i - K 
is a non-zero polynomial defined over the commutator ideal [a, b] . 
For example, notice that if 

dim a = dim b = dim 3 =1 

then N is the 3-dimensional Heisenberg group. Also, our definition 
of bandlimitation is similar to the classical one, in the sense that a 
function is bandlimited if its group Fourier transform is supported 
on a bounded subset of the unitary dual of N. 

First, we provide a precise description of a class of multiplicity- 
free bandlimited subspaces H C L 2 (N) , and an explicit construc- 
tion of a single function cf) G H such that if L is the left regular 
representation of N, there exists a set of the type 

n— 2d d d 

T = J] exp (ZZ k ) J] exp (ZY k ) J] exp (ZX k ) C N 

k=l k=l k=l 

such that L(T)(j) forms an orthonormal basis in H, and is also a 
continuous wavelet for the Left regular representation restricted to 
H. We also show that if the Lie algebra n has a rational structure 
then T is in fact a lattice subgroup of N. We organize the paper 
as follows. The second section deals with some preliminary facts 
which can also be found in the monograph [5], in [2J, and [T2]. The 
third section is the main part of the paper where we provide our 
results. In fact the following theorem summarizes the main result. 

Theorem 1. Let N be a simply connected, connected nilpotent Lie 
group with Lie algebra n satisfying the following, n = 0© b ©3, 
[0, b] C 3, [a, a] = [b, b] = {0}, dim K a=dim K b = d, and as- 
sume that det ([Xi,Yj]) 1<i j <d is a non-zero homogeneous polyno- 
mial over [a, b] . Moreover, let a = M>-span {Xi, • • • , X d } , b = R- 
span {Yi, • • • , Yd} , and 3 = WL-span{Zi, • • • , Z n _ 2( ^} . There is a ba- 
sis for n, a closed left-invariant, bandlimited Hilbert space H C 
L 2 (N) , and a function e H such that if L is the left regular 
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representation of N, the system L (T) forms an orthonormal basis 
for H. Thus the Hilbert space H is a sampling space with interpo- 
lation property. Moreover, (ft is a Sinc-type function. 

We also derive a precise formula for 0, and several examples are 
computed at the end of the paper. 

2. Preliminaries 

Let us start by setting up some notations. In this paper, all 
representations are strongly continuous and unitary. All sets are 
measurable, and given two isomorphic representations r and n, we 
write t = 7i. We also use the same notation for isomorphic Hilbert 
spaces. The characteristic function of a set E is written as xe, and 
the cardinal number of a countable set / is denoted by card (/) . 

Let G be a locally compact group, and let T be a discrete subset 
of G. Let H be a left-invariant closed subspace of L 2 (G) consist- 
ing of continuous functions. We call H a sampling space with 
respect to V if the following properties hold. First, the mapping 
R r : H — > I 2 (r) , R r f = (/ (7)) 7gr is a scalar isometry. In other 
words, there exists a constant c > such that for all / G H, 
S 7 er \f (l)\ 2 = c II/IIh- Secondly, there exists a vector S G H 
such that for any vector / G H, we have the following expansion 
/ ( x ) = S 7 er / (t) S (7 with convergence in the L 2 -norm of 
H. The function S is called a sinc-type function, and if Rr is sur- 
jective, we say that the sampling space H has the interpolation 
property. In other words, every element of I 2 (T) can be interpo- 
lated by a function in H. 

Definition 2. Let (jr, H ff ) denote a strongly continuous unitary 
representation of a locally compact group G. We say that the rep- 
resentation (71", Ht,-) is admissible iff the map : H — > L 2 (G) , 
W^ip (x) = (ip, n (x) 0) defines an isometry of H into L 2 (G) , and 
we say that is an admissible vector or a continuous wavelet. 

It is known that if n is the left regular representation of G, and 
if G is connected and type I, then n is admissible if and only if G 
is nonunimodular. 

Proposition 3. Let <fi be an admissible vector for (71, H^) such that 
7T (r) is a tight frame with frame constant c. Then K = (H. n ) is 
a sampling space, and (0) is the associated sinc-type function 
for K. 
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Proof. See Proposition 2.54 in [6]. □ 

Proposition 4. Let G be a unimodular group. Let H be a left- 
invariant closed subspace of L? (G) consisting of continuous func- 
tions such that the mapping /•->•(/ (7)) er is a scalar isometry. In 
other words, there exists a constant c > such that for all f G H, 
J2jer l/(7)| 2 = c II/IIh- Then H is a sampling space. More pre- 
cisely, there exits a unique self-adjoint convolution idempotent vec- 
tor S such that is the associated sinc-type function. In particu- 
lar, for any function f G H we have f (7) = (/, L (7) S) . Moreover, 
H has the interpolation property iff L (T) S is an orthonormal basis 
o/H. 

Proof. See the Monograph [6]. □ 

We will need to be familiar with the following facts in the third 
section. 

Given a countable sequence {fi} i€l of functions in an Hilbert 
space H, we say {fi} ieI forms a frame if and only if there exits 
strictly positive real numbers A, B such that for any function / G 
H, 

^imi 2 <EK^>i 2 ^ii/ii 2 - 

In the case where A = B, the sequence of functions {fi} ieI forms a 
tight frame, and if A — B — 1, {fi} ieI is called a Parseval frame. 
Also, if {fi} ieI is a Parseval frame such that for all i G /, = 1 
then {fi} ieI is an orthonormal basis for H. A lattice A in M? d is a 
discrete additive subgroup of M. 2d . In other words, every point in A 
is isolated. 

Let A = Al? d for some matrix A. We say A is a full rank lattice 
if A is non-singular, and we denote the dual of A by A T = v4~ 1 ' T A. 
We say a lattice is separable if A = AZ d x B7L d . A fundamental 
domain D for a lattice in M. d is a measurable set such that the 
followings hold, (D+l)n(D+l') ^ for distinct I, V in A, and R d = 

[j (D + I) . We say D is a packing set for A if J2i Xn — t) < 1 

leA 

for almost every x or equivalently if (D + I) D (D + I') has Lebesgue 
measure zero for any / 7^ V . Let A = A7L d x BZ d be a full rank lattice 
in R 2d and g G L 2 (R d ) . The family of functions in L 2 (R d ) , 
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is called a Gabor system. Let m be the Lebesgue measure on R d , 
and consider a full rank lattice A = AZ d inside R d . The volume 
of A is defined as vol (A) = m (R d /A) = |det A\ . The density of A 
is defined as d(A) = |detA|~ . 

Lemma 5. Given a separable full-rank lattice A = AZ d x BZ d in 
R 2d . The following statements are equivalent. 

(1) There exits / £ L 2 (R d ) such that Q (f,AZ d x BZ d ) is a 
Parseval frame in L 2 (R d ) . 

(2) vol (A) = |det AdetB\ < 1. 

(3) There exists f £ L 2 (R d ) such that Q (f, AZ d x BZ d ) is 
complete in L 2 (R d ) . 

Proof. See theorem 3.3 in [2]. □ 

Lemma 6. Let A be a full rank lattice in R 2 . There exists f £ 
L? (R d ) such that Q (/, A) zs an orthonormal basis if and only if 
vol (A) = 1. Also, if Q (/, A) is a Parseval frame for L 2 {R d ), then 

imi 2 = voi(A). 

Proof. See 0. □ 

3. Sampling Spaces on Nilpotent Lie groups 

We will now restrict our attention to nilpotent Lie groups. Let 
N he a, simply connected, connected nilpotent Lie group with Lie 
algebra n. The theory of sampling and interpolation is well under- 
stood when N is commutative. In the case where N is not commu- 
tative, the problem is much harder and several obstructions arise 
very quickly. For example, it is not clear what should be the sub- 
stitute for Z when R is replaced with some general nilpotent Lie 
group N. In fact, there are many nilpotent Lie groups with no uni- 
form lattice subgroups. Also, for general nilpotent Lie groups, the 
Fourier transform is an operator-valued transform, and the support 
set of the Plancherel measure is a non-trivial manifold contained in 
the dual of the Lie algebra (see [5]). However, there are some non- 
commutative nilpotent Lie groups which behave pretty well. For 
example the Heisenberg groups, and various generalizations or the 
Heisenberg groups. 

Let N be a non- commutative connected, simply connected nilpo- 
tent Lie group with Lie algebra n over the reals. Fix a Jordan 
Holder basis for n. Define a = IR-span {Xi, • • • , Xd} , b = IR-span 
{Yi, • • • , Yd} such that the following assumptions hold. 
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(1) n = a © b © 3, [o, b] C 3, a, b are commutative algebras, and 

dim R (0) =dim R (b) = d. 

(2) det (([*,*;■])!<*, 7<d) ^ s a polynomial defined over the com- 
mutator ideal [n, n] . 

This class of groups is a fairly large class of two-step nilpotent 
Lie groups containing the Heisenberg groups. We give below some 
examples of groups satisfying condition 1 and condition 2 given 
above. 

Example 7. Let N be a nilpotent Lie group with Lie algebra n 
spanned by the Jordan Holder basis Z\, Z 2 -> Y 1 , Y 2 , X 1 , X 2 such 
that we have for non-trivial Lie brackets [Xi,Y]] = Z±, [X 2 ,Yi] = 
—Z 2 , [Xi,Y 2 ] = Z 2 , [X 2 ,Y 2 ] = Zi- Here is a faithful matrix repre- 
sentation of this nilpotent Lie group. We define the group homo- 
morphism n : N — >■ GLi (R) ; and put 

p = exp z 1 Z 1 exp z 2 Z 2 exp y x Y x exp y 2 Y 2 exp x x X x exp x 2 X 2 . 

The image of p under the representation -n is the following matrix: 



1 





Xi 


x 2 


-2/1 


-V2 


Zl 





1 


-x 2 


Xi 




y\ 


Z2 








1 











yi 











1 








2/2 














1 























1 
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Example 8. Fix two natural numbers n andd, such that n— 2d > 0. 
Let M be a matrix of order d with entries in RZi©- • -©lRZ„_2d such 
that det (M) is a non-vanishing polynomial on RZi © • • ■ ©IRZ„_ 2 d- 
Now let a = M.-span {X±, • • • , Xd} , and b = M-span {Y±, • • • , Yd} 
such that [Xi,Yj] = M it j. The Lie algebra 

n = a © b© (RZi © • • • © RZ n _ 2d ) 

satisfies all the conditions above. In fact this example exhausts all 
elements in the class of groups considered in this paper. . 

Proposition 9. Let n be a Lie algebra over the reals satisfying the 
following conditions (1) and (2) given above. The following facts 
hold. 

(1) exp (n) is a non-commutative step-two nilpotent Lie group 
which is square-integrable modulo the center. 
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(2) Let A G n* and define 

(2) B(X) = (X[X l ,Y J }) 1 ^ d . 

Then the unitary dual of exp n is parametrized by the smooth 
manifold 

X G n* : det (B (A)) ^ 0, 
A (X0 = • ■ ■ = A (X d ) = 0, 

A (*!) = ..• = A (y d ) = o 

which can be identified with a Zariski open subset ofM. n ~ 2d . 

(3) Let dX is the Lebesgue measure on S. The Plancherel mea- 
sure of N is supported on S and is equal to 

|detS(A)|dA. 

(4) The unitary dual of N which we denote by N is up to a null 
set equal to 

^ = In Cp("® b ) (Xa) : A G E 
where xx ( ex P X) = e - 2mX ( x ) 

(5) Defining 

n—2d d d 

Z = ZjZj, F = ^ i/jFi, and X = ZjJQ, 

i=l i=l j=l 

we realize the representation ir\ as acting in L 2 (lR d ) suc/i 

vr A (expZ)/(t)=e 2 ^/(t), 

n x (e W Y) f (t) = e^*^ f (t) , 

and Ti\ (exp X) f (t) = f (t — x) . 

Proof. The results in this proposition are some elementary facts 
in Harmonic Analysis of nilpotent Lie groups. See [8] where we 
specialized to the class of groups considered here. For more general 
nilpotent Lie groups we refer the interested reader to the standard 
reference [3]. □ 

Definition 10. For a fixed A G £, let u be a lattice in a = M. d 
and let V be a lattice in b = R d . It is clear that for f G L? (lR d ) , 
tt\ (exp u exp d) / is a Gabor system in L? (lR d ) . We say that 

(exp u exp D) / : A G £} 

is a measurable field of Gabor systems. 
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To make the paper more self-contained, we revisit the Plancherel 
theory for the class of groups considered in this paper. We fix 
a Jordan Holder basis for the Lie algebra of n. Assume that N is 
endowed with its canonical Haar measure. V denotes the Plancherel 
transform on L 2 (N) , A = (Ai, • • • , A n _ 2 d, 0, • • • , 0) G E, 

dfi{\) = |det (B{X))\d\ 

is the Plancherel measure (see chapter 4 in [3]), and the matrix 
B (A) is defined in d2J). We have 

V : L 2 (iV) ->■ J & L 2 (R d ) <g> L 2 (R d ) dfj, (A) , 

where the Fourier transform is defined on L 2 (N) D ^(N) by 

7 (/) (A) = f n x (n) / (n) dn, 



and the Plancherel transform is the extension of the Fourier trans- 
form to L 2 (N) inducing the equality 



l HN) = JjV(f) (A)||^(A). 

In fact, || ■ ||^5 denotes the Hilbert-Schmidt norm on L 2 eg) 
L 2 The inner product of arbitrary rank-one operators in 

L 2 (R d ) <g> L 2 (R d ) is given here. 

(u® v,w® y) HS = (u,w) L2 ^ (v,y) L2 ^ . 

Let L be the left regular representation of the group N. It is well- 
known that 

/■© 

L = VLV- X = \ tt a ® l L2 ( Rd) d/i(A), 

and l L 2^ K d^ is the identity operator on L 2 (M. d ) . Finally, for A G S, 

V(L(x)<P)(\)=^(x)o(V<P) (A). 
In order to proceed, we will also need the following facts. 

Definition 11. We say a function f G L 2 (N) is bandlimited if its 

Plancherel transform is supported on a bounded measurable subset 
o/E. Fix 

e = {e(A) : A G E} 
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a measurable field of unit vectors in L 2 (lR d ) . We say a Hilbert space 
is a multiplicity-free left-invariant closed subspace of L 2 (N) if 
and only if 

H (e) = V' 1 [T L 2 (R d ) ® e (A) da (A) 

We define T 1 = exp (ZY X + ■■■ + ZY d ) exp {ZX l + ■■■ + ZX d ), and 

(3) T = exp (ZZ 1 + ■■■ + ZZ n _ 2d ) T 1 C N 

Lemma 12. Ifn has a rational structure ([Xi, Yj] = X]fc=i d c ijkZk, 
Cijk £ Q for all 1 < i,j < d) then T is a lattice subgroup of N. 

Proof. Let Z (k) = k x Z x + ■■• + k n _ 2 dZ n - 2 d, Y (m) = m x Yi + 
■ ■ • + nidYd and X (/) = l\Xi + ■ • • + IdXd. There exists M e 
GL (n - 2d, Q) such that {Z (k) + \ [Y (m) , X (/)] : k h rrij, U E Z} 
is isomorphic to MZ n ~ 2d which we set to be equal to 0. Thanks to 
the Baker-Campbell-Hausdorff formula, 

(d d 
d + ^ZYj + Y^ 
j=l k=l / 

Thus, T is a lattice subgroup of N. For the second part, to show that 
T is a non-type I group, it suffices to show that T contains no abelian 
subgroup of finite index (see Theorem 7.8 in |5J). Suppose that 
there exists T' < T such that T' is abelian and card (T/r') is finite. 
Clearly V since V is not abelian. Now pick 7 G V such that 7 is 
a non trivial element and 7^ 7^ V . Thus, 7!" G T/V. There exists 
X G n such that 7 = exp X and of course 7 J = exp (jX) V. 
The group generated by the element jT' is isomorphic to Z and is 
contained in T/T'. We have reached a contradiction. Thus, T is a 
non-type I group. This completes the proof. □ 

Let 

E = EH {A G S : |det£(A)| < 1}. 
We fixe = {eA:AGE}a measurable field of unit vectors in L 2 . 
Let C C f be a compact set such that {e 2ni{k ' x) XEnc (A) : A G EnC} 
is a Parseval frame for L 2 (EC\C,d\) . We define the multiplicity-free 
closed left-invariant Hilbert subspace H (e, EflC) as follows. 

(4) H (e, EnC) =V- X ( L 2 (R d ) ® e A [det B (A)| dx) . 

\JEnc J 
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Lemma 13. Let <\> G L 2 (N) . If for a.e. AG EnC, T A = u A g> e A , 
V<t>{\) = |det B (A) T 1/2 T A , and if the system Q (u A , Z d x 5(A) Z d ) 
zs a Gabor Parseval frame in L 2 (R d ) , i/ien L (r) (f> is a Parseval 
frame in H (e, EnC) . 

Proof. See [8]. □ 

Here is a sufficient condition to obtain an orthonormal basis of 
the type L (T) in H (e, EnC) . 

Lemma 14. If L (T) <fi is a Parseval frame in H (e, EnC) as de- 
scribed in Lemma (T73|) and if f EnC |detS (A)| dX — 1 then L (T) <fi 
is an orthonormal basis. 

Proof. It suffices to show that H^HnreEnc) = i- R- ecan from Lemma 
H31that for a.e. A G S, T A = u A ®e A , if V<p (A) = |det B (A)p 1/2 T A , 
and if the system Q (u A , Z d x B (A) Z d ) forms a Parseval frame in 
L 2 then ||u a ||^ 2 / R( a = |detB(A)| a.e. Now, 

!l0llH(e, E n C ) = / \\V4>(m 2 Hs\^B(X)\dX 

JEnc 




= [ |det J B(A)|rfA 

JEnc 
= 1. 



Since any unit-norm Parseval frame is an orthonormal basis, the 
proof is completed. □ 

Notice that Lemma [TH does not guarantee the existence of an 
orthonormal basis of the type L (T) 0. In order to proceed, we will 
have to answer the following question. 

Question 1. Is it possible for the following two conditions to be 
both true? Firstly, there exists 4> G H (e, EnC) such that L (T) (f> is 
a Parseval frame in H (e, EnC) . Secondly, J EnC |det5 (A)| <iA = 1. 

The answer to the question is yes. However, the proof will re- 
quire some non-trivial effort. The remaining of this paper will be 
devoted to providing some clear answers to the question. Here is 
a general idea of how we proceed. We first decompose the Hilbert 
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space H (e, EnC) into a finite direct sum of some 'special' Hilbert 
subspaces admitting Parseval frame generators as follows: 

m 

H(e,EnC) = 0Hj. 

3=1 

We construct a Parseval frame generator for each Hilbert subspace 
Hj, and we sum the Parseval frames generators to obtain an or- 
thonormal basis. 

Lemma 15. The basis elements of n can be reseated so that 

/j, ({A G £ : |det£(A)| < 1}) > 1. 

Proof. Let E = {AgE: |det B (A)| < 1} . If fj, (E) > 1 then we are 
done. So let us suppose that 

//(E) = / |detB(A)|dA < 1. 

</E 

Pick a > 1. Put B (A) = (A [X,, lj])i<ij<d and 

fl , (A) = (A[oJC i ,lS-]) 1 < ii ,-< <| . 

It follows that det 5' (A) = adetB (A). Now let 

E' = {A G S : |det£'(A)| < 1}. 

Notice that because a > 1, E' C E and J E , |detS (A)| d\ is finite 
since f E , |det 5 (A)| dA < / E |det 5 (A)| dA. Put 

dn'(X) = |detS'(A)|dA 

and pick a large enough so that 

//(E') = a / |det J B(A)|dA > 1. 

Our new basis is then 

{Zi, ■ ■■ , Z n _2d, Y u ■ ■ ■ ,Y d , otXi, • • • , aX d } . 

□ 

From now on, we will assume that a choice of basis has been 
made so that the condition 

/j, ({A G £ : |detS(A)| < 1}) > 1 

holds. Thus, there exists a compact subset C of 3* such that 

/j, ({A G £ : I det B (A)| < 1} n C) = 1. 
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Put 



HfaEnC)^ 1 



Enc 



L 2 (R d ) <g>e A |det B(X)\d\ 



Notice that the first condition described in Question [T] is easily 
obtained for an appropriate choice of a basis for the Lie algebra n. 
However, the first condition is hard to obtain simultaneously with 
the second. 

Let l : R n ~ 2d -»■ 3 defined by 

L (Ai, ■ ■ • , X n ~2d) = (Al, • • ■ , \ n -2d, 0, • • • , 0) . 

Lemma 16. If /i ({A G S : |det£> (A)| < 1}) > 1, then there exists 
a finite partition o/E PI C = {A G £ : |detS (A)| < 1} fl C denoted 
P swc/i i/iai 



;i) EHC= \jA j 



(2) (Aj) is contained in a fundamental domain of M. n ~ 2d /Z n ~ 2d . 

(3) For each j, where 1 < j < card (P) , there exists a Parseval 
frame (not necessarily an orthonormal basis) of the type 
L (V) 4>j for 

Hj(e,EnC) =V~ 1 [ f L 2 (R d ) ®e x \det B(X)\d\] . 

(4) For each j, satisfying 1 < j < card (P) , we have 

card(P) 

H (e, E n C) = Uj (e, E n C) . 

i=i 

Proof. The proofs for Parts 1, 2 are obvious. The proof for Part 
3 follows from Lemma [T3"| and Part 4 follows from Parts 1,2 and 
3. □ 

Lemma 17. For each 1 < j < card (P) , we can construct a Par- 
seval frame of the type L (T) <pj, such that 

2 

card(P) 

E * 

3 H(e,EnC) 

However, in general ^2^=1^ L (T) <pj is not a Parseval frame for 
H (e, E n C) . 
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Proof. Let E° = E fl C. The existence of a Parseval frame for each 
Hj (e, E°) , 1 < j < card (P) of the type L (T) <pj is given in [S], 
and 



card(P) 

E 



H(e,E°) 



card(P) 

E 



card(P) 
3=1 



MlI^e.E ) 



(E°nAj) 



|det5(A)|dA. 



|det.B(A)|dA = 1. 



Since, U J r 1 d(P) (E° D Aj) — E° then 

card(P) 

E < 

j 1 H(e,E°) 

Finally, for the second part of the proof, it is well-known that in 
general the direct sum of Parseval frames is not a Parseval frame. 

□ 

From now on, we endow M. d with its max norm. In other words, 
given x G M. d , if x = (xi, ■ ■ ■ ,Xd) , \\x\\ = maxi<j<d . The unit 
ball in M. d is the set of all vectors x satisfying the condition ||a;|| < 1. 

Lemma 18. Let Q be a fundamental domain for Z d strictly con- 
tained in the unit ball of M. d such that Q — Q is also contained in 
the unit ball ofR d . If \\B (\) tr \\ < 1 for a.e A G E n C then tt is a 
packing set for B (A) T 7h d for a.e A G E fl C. 

Proof. By contradiction suppose that ||-B(A) <r || < 1 and there ex- 
ists a set of positive measure U C E fl C such that for any A G S, 

there exists k, I G Z d satisfying (n + B (A) T k j n (ft + B (A) T ^ 

for / 7^ k. Put p = I — k. There exist x, y G f2 such that 
x + B (A) T k = y + B (A) T I. Thus, B (Xf (x - y) = I - k and 
\B (X) tr (x — y)\\ . Since p is a non-trivial element of Z d , 



1 < \\B (Xf (x - y)\\ < \\B (X) 



tr I 



X 



and 

\\B(Xf\ 



\x 



y\\ < lis (A) 



tr I 



sup \\Z\ 



< sup ||z| 



< 1 on [/. 



So, 1 < ||S(A) tr || <lon5 and ||5 (A) 
be a contradiction. 



tr I 



1 on S. That would 
□ 
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Corollary 19. If\\B (A) tr || < 1 for a.e A G E n C then [-1/2, l/2) d 
is a packing set for (B (A)* 7 ) 1 Z d , for a.e A G En C. 

Lemma 20. // \\B (A)' r || < 1 for a.e. A G E n C, then 

e(x H/2l i /2] ^ i xB(A)Z i ) 

is a tight frame for L 2 (lR d ) with frame bound 1/ |det B (A)| . 
Proof. By Proposition 3.1 in [12], the Lemma is true. □ 

Lemma 21. There exists a basis for the Lie algebra of N for which 
EflCcE such that for all A G E n C, \\B (A) <r || < 1. 

Proof. Let I = {A G S : |det 5 (A)| < 1} , and let 

R= {A G S : ||fi(A)* r || < 1}. 

Notice that both sets are open in £ and /i (I fl R) > 0. We have 
two separate cases to treat. For the first case, let us assume that 

/i(inR) > l. 

There exists a compact set C C 3* such that /i (I fl R fl C) = 1. 
For the second case, assume that \i (I fl R) G (0, 1) . We pick a new- 
basis 

{Z\, ■ ■ ■ , z n _2d, x[,--- , x' d , y 1: ■ ■ ■ , yj} 

for the Lie algebra n such that Bp(\) = (A [X-,!^'])^. and 
Bp (A) = /T 1 (5 (A)) for a.e. A and (3 > 1. Next, we define' ~ 

Ip = {A G S : |det5 /3 (A)| < 1} = {A G S : |detS(A)| < /3 d } , 
R/3 = {A G S : 1(5,3 (Af|| < 1} = {A G S : \\Bp (A)* r || < 0} . 

First notice that Ip fl R^ D I fl R, and also that as (3 — > oo, Ip n 
R/3 — >■ E. Thus /i (1/3 D R^) > n (I fl R) and for /3 large enough, we 
have 

fi{ipnKp) > l. 

We can then find a compact set Cp C 3* such that // (Ig fl R/3 fl C) = 
1. " □ 

Theorem 22. Suppose that for a.e. A G E n C, \\B (A) <r || < 1. 
For each 1 < j < card (P) , there exists 4>j & Hj (e, E fl C) s«c/i 
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that L (r) (f)j is a Parseval frame for EL, (e, E D C) , and for = 
EJ=f (P) <t>v L ( r ) <t> iS an ONB m 

card(P) 

H (e, E n C) = Uj (e, EnC). 

i=i 

Proof. Put E° = E R C. For j = 1, let us define the function <f>\ e 
Hi (e, E°) such that 

V(<h)(\)= (ui®e A )|det J B(A)r 1/2 , 

and the Gabor system Q (u A , Z d x B (A) Z d ) forms a Parseval Ga- 
bor frame in L? (R d ) . As shown in Cor (fl9|) we can pick a measur- 
able subset E (A) of M d such that E (A) = [—1/2, l/2] d is a fun- 
damental domain for Z d and a packing set for 5(A) T Z d for a.e. 
A G E°. By Lemma [201 

g{ X E { x)X^B{\)Z d ) 

is a tight frame for L? (M d ) with frame bound 1/ |det S (A)| . Next, 
if we let u\ = |det B (A)| 1/2 X e(x) then 6? (u A , Z d x 5 (A) Z d ) forms 
a Gabor Parseval frame in L? (lR d ) . We define for j ^ 1, (f>j e 
(e, E°) such that "P</>j (A) = (u{ g> e A ) |det B (A)f 1/2 and 

(5) uj = |det J B(A)| 1/2 X i ? (A) +fej ,^ G Z d . 

Furthermore, we assume that for each 1 < j, I < card (P) , kj ^ ki 
whenever j ^ I. Now, let if) be any arbitrary element in 

card(P) 

H(e,E°) = H,-(e,E ) 

3=1 

such that ip = ^i=i V'i) f° r i'j e (e, E°) . Recall that 
Ti = exp (ZYi + ■ ■ ■ + ZF d ) exp (ZXi + ■ • • + ZX d ) . 
Next, letting = ^J r 1 d(P) </>j, and r (A) = |det 5 (A)| , 

^|(^,L( 7 )0)| 2 = ^ 
7er 7 er 



/ (ViP(X),7r x ( 1 )V ( f>(X)) HS r(X)dX 
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Using the fact that it\ (Y fl 3) xe° forms a Parseval frame for L 2 (E°) , (see 
Part 2 of Lemma [TB]) ; defining functions s 71 , s 7i on E° by 

s 7l (A) = (PV (A) , vr A (71) (A) r (A) 1/2 \ , and 
\ I us 

us 



sl n (A) = (V^ (A) , vr A ( 7l ) (A) r (A) 7 ) 



we have 

(6) YtMM-r) 

7er 



/ E l^(A)| 2 r(A)rfA 



71 er 



7ieri 



card(P) 

E < w 



r (A) dX. 



Now, letting (A) = w A ® e A , we have 

4i (A) = (7i) u l) L 2( Rd ) 



Thus, for k, m G Z d 
< (A) = 



u;{ (S (A) _tr e 27ri ^>r(A)- 1/2 ^. 

'_B(A) tr (_B(A)+fc : j+m) 

Since -E (A) is a tiling set for M. d , if 

j,/g{1,--- ,card(P)}, 

and if j ^ I then 

B (X) tr (E (A) + kj + m) n 5 (A)' r (E (A) + fc, + m) = 0. 
Put s 71 (A) = Sj. m (A) . For each m G Z d , the sequences 

(4,m(A)) feeZd and « m (A)) fceZd 

are orthogonal because they are Fourier inverses of the following 
orthogonal functions: 



and 



w{(B(X) tr t)r(X) 1/2 X B(x yr {E{XHkj+m) (t) 
(B (\y tr t) r (A)~ 1/2 XB(x)^(E(x)+k l+ m) (*) • 



w 
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E 

7ieri 



card(P) 

E < ( A ) 

3=1 



card(P) 

E E KWI 2 - 



7ieri j=i 



Coming back to Equation ([6]), we have 



0>| : 



E 

71 er 

card(P) 



card(P) 
3=1 



r (A) dX 



/EE k 7l (A)| 2 r(A)rfA, 
Je ° i=i 7i er, 



and 



card(P) 



|(^,L( 7 )0)| 2 = £ [ {\\V^ (X)f HS ) r (X) dX 
=1 JE°n J 4j 



j 

card(P) 

E 

3=1 



^'llH^e.E ) 



lH(e,E°) • 

Now, we compute the norm of the vector 



H(e,EnC) 



\\Vcj> j {X)t iS r{X)dX 



E 



card(P) 



/ E <S> e A ) r (A) 

Je ° 3=1 " 

card(P) 

/ E IK® e 4L rfA 

jE ° 3=1 



-1/2 



US 



r(X)dX 



r- 

card(P) 



E' 



E II" 



3=1 



A|lL 2 (R d ) 



dX. 



Using the fact that E° = lEJ^ (E° n A 



3) ' 



2 

H(e,E°) 



U 



ca r d(P) (Eonylj) 



A|lL 2 (R d ) 



dX 



[ \det B(X)\dX = 1. 
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Since L is a unitary operator, and since L (T) forms a unit norm 
Parseval frame, L (T) forms an orthonormal basis in H (e, E°) . 

□ 

In summary, we fix a basis for the Lie algebra of N such that 
for all A G EnCc S, we have ||-B(A)* r || < 1. Defining <\> = 

^card(P) ^ 



(A) = (^X[_l/2,l/2] d +fe ® X[-l/2,l/2] d +fe 

it follows that L (V) </> is an orthonormal basis for the Hilbert space 
H (e, E n C) where 

e = je (A) = X[-i /2 ,i/2} d +k : A G E n C} . 
Now, we fix a Gabor orthonormal basis 

B = [b ld it) = e 2 ^x hl/2il/2 f it - j) : (j, /) G Z d x Z d ) 

for L? (R d ) . We derive a formula for (p as follows. Let F be the 
Fourier transform defined on L 2 (R d ). Let n G N, A G EflC, 
and (j,/) G Z d x Z d . Let n = zyx where z is central element, 
y G exp (b) and x G exp (a) . Put £ = [-1/2, l/2] d C R '. We 
define f (n, A, Z, j) = f (zyx, A, l,j) as being equal to 

e 2,i { X, Z ) e 2m(B(X)y + l,j) F fa^^-e^*^) (I) . 

Proposition 23. Put d\x (A) = det \B (A)| cZA. ^4 sinc-type function 

in H (e, E fl C) has the following precise formula: 

(7) 

0(n)= / ^ (^ fc (e 2 ^ S znc(/))f(n,A,/,j))rf/i(A). 

fce{l,--' ,card(P)} 

Proof. Using the inversion formula provided in Theorem 4.4 in the 
monograph [B], 



0(n) 



/ card(P) \ 

/ trace ^ "P (4>k) (A) o 7r A J det \B (A)| c?A. 

^Enc y fe=1 y 
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Also, 

'card(P) 



>7r A (n) 



trace Y V ^ ( A ) ° 
y k=i 

/card(P) \ 

= Y \ Y (X[-1/2,1/2] J +* ® X[-l/2,l/2]' i +fc) ff A &lj j 

(j,l)£Z d xZ d \ k=l I 

card(P) 

= Y Y ((x[-l/2a/2] d +fc®X[-l/2,l/2] d +fc) ^H^jAj) 

(j,l)£Z d xZ d k=l 

card(P) 

Y Y \ & ^'' ^[-l/2,l/2] d +fc) k,j, X[_l/ 2 ,l/2] d 



(j,l)£Z d xZ d k=l 

Since 



(blji ^[-l/2,l/2] d +fc) — / e27ri ^'*^[-l/2,l/2] d i) ^[-l/2,l/2] d +fc (*) ^ 



2 7 ri(M> dt . 



dj,fc / e 

</[-l/2,l/2] d +fc 

Let F be the Fourier transform defined on L 2 (R d ) . Then 

( b i^X[-i/ 2 ,i/2] d + k) = 5 i,kF (x[-i/2,i/2] d +fc) (0 = 5 hk e 2m{l ' k) smc(l) . 

Recall that n = zyx where z is central element, y G exp (b) and 
x G exp (a) . Put E = [-1/2, l/2] d . 

<tt a 6 W , XE+k) = (bi,j, tta (n) XE+k) 

= e 2m ^ [ e 2m ^ X E (s) e 2m ^ x ^ s ^XE+k {s + j - x) ds 



= e 2 ^ J e 2 ^ l ^XE (s) e 2 ^y^ XE+k+x _ 3 (s) ds 

= e 2TTi(\,z) e 2-Ki{l,j) e 2TTi(B(\)y,j) f e ^i(l,s) ^m(B{X)y,s) dg 

J EnE+k+x-j 

= e^e^^F (xEnE+k+x-i (•) e 2 ^ B ^) (I) . 
Finally, we obtain the formula in ([7]). □ 
Proposition 24. Let <ft be as defined in Theorem{£M Then 

(A)|| M = 1 
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for a.e. A G E fl C, and <fi is an admissible vector for the represen- 
tation (L, H (e, E fl C)) .. 

Proof. For any given A G E fl C, there exists a unique indexing 
element j such that A G E fl C fl Aj (see Lemma [TBI) and 

2 



\V{4>) (A) || 



HS 



(u J x ®e A ) |detE(A)| 



-1/2 



|det5(A)T 1 lluj 



lL 2 (R d ) 



From 



\v(4>) WW 



det J B(A)p 1 |det J B(A)| i/z X i?(A) 



1/2 



1. 



L 2 ( 



Thus, is an admissible vector (see [6]) for the representation 
(L, H (e, E fl C)). □ 

Recall that 

^:H(e,EflC) L 2 (JV) , (z) = (V, tt (a;) 0} . 

Theorem 25. Let 6e as defined in Theorem [IB T/te Hilbert 
subspace H (e, E fl C) is a sampling space and has the interpolation 
property. Moreover, (H (e, E fl C)) is a sampling space with 
sinc-type function ((f)) , and <fi is constructed in Proposition [2R 

Proof. The proof follows directly from Proposition [3j Proposition H] 
and Theorem EZl □ 



Example 26. Let N be a nilpotent Lie group with Lie algebra n 
spanned by the following fixed basis 

{Zi, Z 2 , Yi, Y 2 , Xi, X 2 } 

such that we have the following non-trivial Lie brackets 



[X 1 ,Y 1 ] = [X 2 ,Y 2 ] = -Z 1 ,[X 2 ,Y l ] 



1 



and [X U Y 2 ] = \Z 2 . Put 



r = \\ exp (ZZ k ) Y[ exp (ZY k ) J] exp (ZX k 

k=l k=l k=l 

The Plancherel measure is supported on the manifold. 

A G n* : A (Z x f + A (Z 2 f ± 
\{Y j ) = 0,\(X j ) = 0forl<j<2 
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Now put E = {(A x , A 2 , 0, • • • , 0) <E E : Xj + X\ < 25} and 



E° 



(A 1 ,A 2 ,0,-- - ,0) GE: 



It is not too hard to see that for all A G E°, ||S (A) <r || < 1. Thus 
by Theorem there exists a function in H (e, E°) whose set of 
translates by elements of V forms an orthonormal basis. The set 
E° is by no means unique. In fact, we could also choose 



E= (A 1 ,A 2) 0,-,0)eE:i i + ! , i <5 - 



2X l/2- 



7T 



The Hilbert subspaces 

(Xj + A 2 ) dX x dX 2 



H (e, E°) = P- 1 (^J {L 2 (R 2 ) ® e A ) 



25 



and 



H (e,E) = ( jT (£ . (R2 ) s 6A ) <A±M^l} 

are sampling spaces with interpolation properties with respect to T. 

Example 27. Let N be a nilpotent Lie group with Lie algebra n 
spanned by the following fixed basis: 

{Zi, Z 2 , Yi, Y" 2 , Y3, Xi, X2, X3} 

with non trivial Lie brackets. 

[X U Y X ] = [X*,Y 1 ] = ^Z X 

[x 3 ,y 2 ] = [x 3 ,y 3 ] = ±z 1 , 
[x 2 ,y 1 ] = [x 2 ,y 2 ] = ±z 2 . 

Let 7r : N — > GL (9, M) be a monomorphism such that for 

2 3 3 

p = n exp ( zkZk ) n exp ^y^) n exp o*^*) 
fe=i fc=i fc=i 
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we define 



1 





Xi + x 3 


x 3 


x 3 


yi 





V\ + 2/2 








10 


10 


10 


10 




10 


Z\ 







X 2 


X2 








yi + V2 







1 












To 


To 






10 










1 

















yi 











1 














2/2 














1 











V3 

















1 





























1 





























1 





























1 



it is a faithful matrix representation of N. Let 

2 3 3 

T = J] exp (ZZ k ) 11 exp (ZY k ) J] exp (ZX k ) . 

k=l k=l k=l 

Moreover, the Plancherel measure is supported on the manifold 

y = j \en*:\(Z 1 f\(Z 2 )^0, \ 
\ \(Y j )=0,\(X j ) = 0forl<j<3 /■ 

Let a = 2 2 / 5 3 1/5 5 3/5 , and defining 

F o / A G E : A (Z 1 ) 2 |A (Z 2 )\ < 1000 \ 
\ -a< \(Z 1 ),\(Z 2 )<a /' 

i/ie Hilbert subspace 

H (e, E°) = (£ (L 2 (R 3 ) ® e A ) ^d\ 1 d\ 2 } 

is a sampling space with interpolation property with respect to T. 

Example 28. Let N be a nilpotent Lie group with Lie algebra n 
spanned by the following fixed basis: 



{Zi, Z 2 , Yi, Y 2 , Y3, Y4, X±, X 2 , X3, X4} 
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with non trivial Lie brackets. 





= ±Z 1 ,[X 1 ,Y 2 ] = 


[X 2 ,Y 2 ] 


= ^Z U [X 3 ,Y 3 ] = 




= ~Z 1 ,[X A ,Y 4 \ 


[X 5 ,Y 6 ] 


= y^2, [^6,^5] = 



1 1 

-Z 2 ,[X 2 ,Y 1 ] = --Z 2 

-Z 2 ,[X 3 ,Y 4 ] = -Z 1 

1 1 

= ^Z 2 ,[X 5 ,Y 5 ] = -Z 1 

-Z 2 ,[X 6 ,Y 6 ] = -Z 1 . 



Let 



r = \\ exp (ZZ k ) \{ exp (ZY fc ) JJ exp (ZX fc ) . 

k=l k=l k=l 

Defining 

r(M z 1 ),A(z,)) = ^!^^)')(M^ , + M^y 



15625 

3 \ 1/8 , 



and a = (^) 2 3 / 8 35 3//s , we obtain the support of the Plancherel 
transform as follows: 

Aen*:|r(A(Z 1 ),A(Z 2 ))|^0, 
A(r,)=0,A(X J ) = 0/orl<j<4 



AGS: |r(A(Z!),A(Z 2 ))| < 1 
-a < A (Z 1 ) , A (Z 2 ) < a 



£ = 

Defining 

E 1 

£/ie Hilbert subspace 

H (e, E°) = p- 1 ^ (L 2 (M 3 ) <g) e A ) |r (Ai, A 2 )| d\id\ 2 
is a sampling space with interpolation property with respect to Y. 
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